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We have studied the mass hierarchy with atmospheric neutrinos considering the muon energy and 
zenith angle of the event at the magnetized iron calorimeter detector. For \ 2 analysis we have 
migrated the number of events from neutrino energy and zenith angle bins to muon energy and 
zenith angle bins using the two-dimensional energy-angle correlated resolution functions. The bin- 
ning of data is made in two-dimensional grids of log 10 E — L 4 plane to get a better reflection of the 
oscillation pattern in the \ 2 analysis. Then the x 2 is marginalized considering all possible system- 
atic uncertainties of the atmospheric neutrino flux and cross section. The effects of the ranges of 
oscillation parameters on the marginalization are also studied. The lower limit of the range of #13 
for marginalization is found to be very crucial in determining the sensitivity of hierarchy for a given 
#13. Finally, we show that one can discriminate atmospheric neutrino mass hierarchy at >90% C.L. 
if the lower limit of 613 > 5° . 

PACS numbers: 14.60.Pq 



I. INTRODUCTION 

The origin of masses of the particles and their inter- 
actions have been successfully described by the stan- 
dard model (SM). The recent discovery of neutrino 
masses and their mixing through neutrino oscillation 
[1, 2] opens a new window beyond the SM. This provides 
the measurements of mass squared differences Am^ = 
to 2 — mf and mixing angles 9ij. At present 1(3)<t 
ranges are [3]: Am 2 21 = 7.67t° ^(t°g) x l(T 5 eV 2 , 
lAn&l - 2.39t° i 1 (t° ;g) x HTW, sin 2 12 = 

o.3i2lS:S8(±S:8S). = oAeet^inill), and 

sin 2 6>i3 = 0.016±o;oio(< 0.046). Here % are the mixing 
angles in Pontecorvo, Maki, Nakagawa, Sakata mixing 
matrix [4]. Currently, there is no constraint on the CP 
violating phase Sqp or on the sign of Am^. The neu- 
trino mass ordering is one of the key problems to build up 
the fundamental theory of the particles beyond the SM. 
This can be probed through neutrino oscillation. In this 
paper we have concentrated on the prospects to resolve 
the mass hierarchy using atmospheric neutrinos. 

The mass hierarchy with atmospheric neutrinos has 
been studies in [5-7] with a large magnetized Iron 
CALorimeter (ICAL) detector, which is being strong con- 
sidered for the India-based Neutrino Observatory [8]. In 
[9], the authors estimated the sensitivity of a large liq- 
uid argon detector. This is nonmagnetized, but can de- 
tect both electron and muon. So, here the statistics are 
high compared to ICAL. However, these studies have 
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dealt with neutrino energy and zenith angle and assumed 
fixed Gaussian resolutions for them separately. It is also 
shown that the confidence level of determining hierarchy 
changes drastically with the change in width of resolu- 
tions. Moreover, since all of the particles produced in 
the neutrino interactions can not be reconstructed, the 
resolutions are not Gaussian in nature. There are many 
neutral particles in the deep inelastic processes, and the 
non-Gaussian nature of the resolutions increases as one 
goes to higher energies. Again, the resolutions are dif- 
ferent for neutrino and antineutrino (see Fig. 4 of [10]) 
since the different quantum numbers are involved in the 
scattering matrix elements for neutrino and antineutrino. 
At energies around 1 GeV, most of the events are quasi- 
elastic, and the muon carries almost all of the energy of 
the neutrino. Here, the energy resolution is very good. 
As the energy increases, the deep inelastic process dom- 
inates and the energy resolution begins to worsen by de- 
veloping a more prominent non-Gaussian nature. How- 
ever, the trend of angular resolution is quite opposite, its 
width is very wide at low energy, and it improves with an 
increase in energy. So, it is very important to study the 
sensitivity of a detector in terms of directly measurable 
quantities. 

We have studied the neutrino mass hierarchy for the 
magnetized ICAL detector with atmospheric neutrinos 
generating events by NUANCE-v3 [11] and consider- 
ing the muon energy and direction (directly measurable 
quantities) of the event. Because of heavy mass of the 
muon, it looses energy mostly via ionization and atomic 
excitation during its propagation through a medium. 
Since ICAL is a tracking detector, it gives a clean sin- 
gle track in the detector. The muon energy can be mea- 
sured from the bending of the track in the magnetic field 
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or from the track length in the case of a fully contained 
event. The direction can be measured from the tangent 
of the track at the vertex. From the GEANT [12] simula- 
tion of the ICAL detector it is found that the energy and 
angular resolutions of the muons are very high (4-10% for 
energy and 4-12% for zenith angle) and negligible com- 
pared to the resolutions obtained from the kinematics of 
the scattering processes. A new method for migration 
from true neutrino energy and zenith angle to muon en- 
ergy and zenith angle has been introduced in [13] and 
subsequently used in [10, 14, 15]. 

On the other hand, the binning of the data is also 
an important issue when one considers the binning of 
the events in reconstructed energy and zenith angle bins. 
The reasons are the following: The atmospheric neutrino 
flux changes very rapidly with energy following a power 
law (roughly <~ E~ 2 - s ). Again, the behavior of the os- 
cillation probability changes with the change in zones of 
E — L plane. This has been discussed in [10, 14]. In 
case of proper binning of the data [10], the precision of 
oscillation parameters improves. Then it helps in hierar- 
chy discrimination by reducing the effect of the ranges of 
the parameters, over which the marginalization is carried 
out. 

In our previous work [13], the x 2 analysis has been car- 
ried out considering the ratio of total up and total down 
going events for each resonance zone. Since the ratio 
up/down cancels all overall uncertainties, we considered 
only the energy dependent one. However, it should be 
noted here that the ratio of two Gaussian observables is 
not an exact Gaussian function. Our previous x 2 study 
assuming the up/down ratio as a Gaussian function was 
motivated by the cancellations of all overall uncertainties. 
So, the result was an approximated one. 

It is important to estimate the sensitivity of hierarchy 
determination with realistically measurable parameters 
of the experiments through a detailed analysis. Here, 
we have performed the x 2 analysis following Poissonian 
distribution and considering the number of events in the 
grids of the log 10 E~L 0A plane of the muon. This follows 
Poissonian (Gaussian) distribution for a less (large) num- 
ber of events. For a large number of events Poissonian 
distribution tends to a Gaussian one. We have taken 
into account all possible systematic uncertainties using 
the pull method of the % 2 analysis. Expecting the lower 
bound of #i3 to be known from other experiments like 
Double Chooz [16] or NO^A [17], we have also estimated 
the improved sensitivity considering the lower bound of 
#13 for marginalization as the input value of #13 for gen- 
erating the experimental data for the x 2 analysis. 



With this one mass scale dominance approximation, 
the survival probability of can be expressed as 
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The mass squared difference (Am^)" 1 and mixing an- 
gle sin 2 29^ in matter are related to their vacuum values 

by 
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where, the matter term A = 2^/2GFn e E = 7.63 x 
10~ 5 cV 2 p(gm/cc) E(GeV) eV 2 . Here, G F and n e are 
the Fermi constant and the electron number density in 
matter and p is the matter density. The evolution equa- 
tion for antineutrinos has the sign of A reversed. 

From Ens. 1 and 2 it is seen that a resonance in P.™, 
will occur for neutrinos (antineutrinos) with normal hi- 
erarchy (inverted hierarchy) when 



sin 2 26>^ 1 or, A = Am 2 : cos 26>i 3 . 



Then resonance energy can be expressed as 
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The difference AP between F^fAm^) and 
Pnn{— Amli) has been plotted in Fig. 1 for 
and Dfj, with #13 = 2° and #13 = 10°, respectively, as an 
oscillogram in a two-dimensional plane of E — cos6 |nadlr . 
We see that there exists a difference in all E — cos 6* nadlr 
space. This is not due to the matter effect, but due to 



the nonzero value of Ar 



l 21- 



So this exists for 13 = 0° 



also. It is seen that the resonance zones arc different for 
v and v and both their areas and amplitudes squeeze 
with a decrease in 6*13 values. 



III. THE X ANALYSIS 



II. OSCILLATION FORMALISM 

To understand the analytical solution of time evolu- 
tion of neutrino propagation through matter, we adopt 
the so-called "one mass scale dominance" frame work: 
lAm^l << |m§ - ml 2 \ [18, 19]. 



The x 2 is calculated according to the Poisson proba- 
bility distribution. The binning the data is made in two- 
dimensional grids in the plane of log 10 E - L aA of the 
muon. The method for migration of number of events 
from neutrino to muon energy and zenith angle bins, the 
number of bins, the systematic uncertainties, and the 
cuts at the near horizons are described in [14]. 
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Neutrino, 6n=2 




FIG. 1: The oscillogram of the difference P MM ( — Am^) — P M(J (Am| 1 ) in the E — cos# na di r plane for #13 = 2° (top) and On = 10° 
(bottom) with (left) and (right), respectively. We set |Am§ 2 | = 2.5 x lCT 3 eV 2 , 6*23 = 45°, S C p = 180°, and other oscillation 
parameters at their best-fit values. 



The fact is that neutrino cross sections have not been 
precisely measured at all energies, and the neutrino flux 
is also not precisely known at every energy. There may 
arise an energy dependent systematic uncertainty. We 
may not always realize this. The program NUANCE 
considers difference processes of interactions at different 
energies using the Monte Carlo method. This may not 
be fully captured when we generate theoretical data by 
folding the flux with total cross section and smearing 
with the resolution functions[10]. The similar situation 
may happen in real experiments also. The mass hierar- 
chy is determined considering the difference in number 
of events between normal hierarchy (NH) and inverted 
hierarchy (IH). This arises for the resonance in neutrino 
propagation through matter. It happens for some partic- 
ular zones of energy and the baseline. So, there may arise 
a large difference in estimated hierarchy sensitivities with 
and without consideration of this systematic uncertainty. 
One can generate the experimental data for % 2 analysis 
in two ways: I) directly from NUANCE simulation for 
a given set of oscillation parameters with 1 Mton.year 
exposure and then binning the events in muon energy 
and zenith angle bins; II) considering the oscillated at- 
mospheric neutrino flux for a given set of parameters and 
then folding with time of exposure, total cross section, de- 
tector mass and finally smearing it with the energy-angle 
correlated resolution functions. This is similar with the 
method of generating the theoretical data for x 2 analysis. 

One can generate the theoretical data directly from a 
huge data set, say, 500 Mton.year data (to ensure the 



statistical error negligible) for each set of oscillation pa- 
rameters and then reducing it to 1 Mton.year equivalent 
data from it, which would be the more straightforward 
way for method I of generating experimental data. In 
this case, the effect of the above systematic uncertainty 
will not come into the play. The marginalization study 
with this method is almost an undoable job in a normal 
CPU. When we adopt different methods for generating 
theoretical and experimental data, the significant effect 
of the above systematic uncertainties come into the re- 
sults. So, we adopt the same method for them and here 
we consider method II. 



IV. RESULTS 

We marginalize the % 2 over all the oscillation parame- 
ters ATO32, 623, #13, and <5cp along with solar oscillation 
parameters Am^ and 6*12 for both NH and IH with ^s 
and vs separately for a given set of input data. Then we 
find the total x 2 [= xl + Xv] ■ 

We have chosen the range of Am| 2 = 2.0 — 3.0 x 
10" 3 eV 2 , 6» 2 3 = 37°-54°, 13 = 0°-12.5° and 8 C p = 0°- 
360°. We set the range of Am^ = 7.06 - 8.34 x 10" 5 eV 2 
and 6*12 = 30.5° — 40°. However, the effect of Am 2 ^ comes 
in the subleading order in the oscillation probability when 
E ~ GeV and it is marginal. We set the input of atmo- 
spheric oscillation parameters |Am| 2 | = 2.5 x 10 -3 eV 2 , 
#23 = 45°, and Sep = 180° and the solar parameters 
Am^ = 7.9 x 10~ 5 eV 2 and 12 = 33°. We set IH as in- 
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FIG. 2: The variation of marginalized \ (false) with different input values of 



input IH, 9,3=7.5° 
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FIG. 3: The variation of x w ' tn "i3j $23, and Am 32 , respectively for both true and false hierarchy. The x ,s marginalized with 
respect to all oscillation parameters except with which it varies. 



put. The variation of marginalized \ 2 f° r different input 
values of #13 is shown in Fig. 2. 

To see the effect of marginalization over the ranges of 
parameters, we have shown the variation of \ 2 f°r both 
true and false hierarchy as a function of #13, 823 and 
IATO32I in Fig. 3. Here, we have marginalized the \ 2 
over all oscillation parameters except one with which it 
varies. We find that significant improvement will come 
if the lower bound of 813 improves from zero. This is 
demonstrated in the first plot in Fig. 3. We also see 
from this figure that there is no significant effect of other 
parameters on marginalization since they are well deter- 
mined in this experiment. We find from Fig. 4 that if the 
lower limit is 5°, the mass hierarchy can be determined 
at a confidence level > 90%. 

The absolute bounds of each oscillation parameter can 
also be seen in Fig. 3 when one sees the curve for its true 
hierarchy. It should be noted here that in the case of 
method II, the best-fit values are same with their input 



values, which is not always the case in analysis using 
method I (discussed in [10]). However, the precision of 
the parameters is almost same here with method I (which 
is used in our previous work [10]). 

We have further studied for the cases when the lower 
limit of the range of #13 for marginalization is the in- 
put value for the experimental data set. Considering this 
constraint we have plotted the variation of x 2 with input 
values of #13 in Fig. 5. This will give the lower limit 
of the sensitivity of the mass hierarchy in this detector 
when the lower limit of 813 is known from other experi- 
ments like Double Chooz [16] or NOvA [17]. A significant 
improvement is observed comparing Figs. 2 and 5. 
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FIG. 4: The same as Fig. 3, but with 6*13 only and with input 6*13 = 5°. 
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FIG. 5: The same as Fig. 2, but the lower limit of the range of #13 for marginalization is the corresponding input value used for 
generating the experimental data set. This gives the lower limit of the sensitivity corresponding to a lower limit of 813 obtained from 
other experiments. 
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